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Abstract 

In these notes, we continue our investigation of classical toy models of disordered statisti- 
cal mechanics, through techniques recently developed and tested mainly on the paradigmatic 
Sherrington-Kirkpatrick spin glass. Here, we consider the p-spin-glass model with Ising spins 
and interactions drawn from a normal distribution Af[0, 1]. After a general presentation of 
its properties (e.g. self-averaging of the free energy, existence of a suitable thermodynamic 
limit), we study its equilibrium behavior within the Hamilton-Jacobi framework and the 
smooth cavity approach. Through the former we find both the RS and the 1-RSB expres- 
sions for the free-energy, coupled with their self-consistent relations for the overlaps. Through 
the latter, we recover these results as irreducible expression, and we study the generaliza- 
tion of the overlap polynomial identities suitable for this model; a discussion on their deep 
connection with the structure of the internal energy and the entropy closes the investigation. 

1 Introduction 

In these notes we continue our investigation on the mathematical methods and the physics 
underlying many body interactions, namely we adapt recent mathematical techniques to the 
study of equilibrium statistical mechanics of p-spin glasses. In the past we analyzed p-spin 
systems with the simpler ferromagnetic couplings [11 J and p-spin systems with diluted coupling 
[2], while now we turn to p-spin systems with frustrated couplings, which are termed p-spin 
glasses [331H51. 

We first introduce the model, with all the necessary definitions stemmed from statistical 
mechanics, and then we adapt the Hamilton-Jacobi technique (developed for the Sherrington- 
Kirkpatrick model by Guerra [20j and later enlarged to a broad validity [5J [TUl EEl 29J) to these 
systems, so to be able to solve the model (in some physical approximation, that is, replica 
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symmetric and one-step of broken replica symmetry, as discussed later), without any relation 
with the original statistical mechanics framework. 

This has two advantages: the development of a clear and powerful mathematical alternative 
to solve the thermodynamics of these many body systems, and a further rigorous confirmation 
of results raised in the theoretical physics scenario. 

Then, we adapt the method of the smooth cavity to the same problem to obtain another 
series of results: in particular, after recovering a clear picture of the thermodynamics in perfect 
agreement with the previous part of the work and with existing results, we focus on the polyno- 
mial identities often called Aizenman-Contucci |6] and Ghirlanda-Guerra |17] relations. We will 
show how to prove their validity even for the p-spin glasses considered here and we will try to 
revise their deep physical meaning ultimately offering a unifying framework where cavity fields 
|24| and stochastic stability [12] merge to work synergically [9]. Furthermore, comparison among 
the results obtained with both the methods will provide the reader with a deeper understanding 
of the techniques themselves as well as of the physical properties of these models. 

In order to be comprehensible for both the communities of theoretical physicists and of 
mathematical physicists, the two methods are exposed with a slightly different approach. In the 
former (closer to the first community), results are presented in form of a theorem following the 
related proof, which is never explicitly expressed as a "proof", while in the latter (closer to the 
second community) results are first declared and then proved. 
Finally, in the last section we discuss results and possible outlooks. 

2 The model and the related statistical mechanics package 

The p-spin glass is the model for a system of spins a, i. e. dichotomic variables which can take 
the values ±1, interacting together in p-tuples with random couplings Ji 1 ....i p , and, possibly, with 
an external field h. The Hamiltonian is the function which defines the model and physically 
speaking represents the extensive energy associated with a given configuration of the spins, for 
a certain value of the couplings and of the external field. 

Definition 1. Given a system of N spins Oi, i = 1,...,N, the Hamiltonian associated with a 
configuration a = <7/\r} of the spins, interacting in p-tuples and with an external uniform 

magnetic field h, is defined as follows: 

I j 1,JV N 

H N (a,J,h) = -J 2Np _x Yl J ii...i P a il- a ip- h ^2 a i- (!) 

ii<...<i p i=l 

The first summation is taken over all the possible choices of indices l<ii<...<i p <A^ and 
the couplings J are independent standard Gaussian random variables. This can be considered 
as a generalization of the well known Sherrington-Kirkpatrick model (SK) and its interest lays 
in the fact that its low temperature behavior is much simpler than in the SK model. The 
normalization factor preceding the first sum ensures that the Hamiltonian is an extensive quantity 
(i.e. proportional to the number of spins N) and the 2 at the denominator allows recovering the 
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SK definition when p =2. 

For the sake of simplicity we only consider the case of an even number p of interacting spins. In 
this case the system has a gauge symmetry when the external field h is set equal to zero: it is left 
invariant under the transformation o~i k —> (Ji k <Ji p+1 for all k = 1,2,..., p. Moreover, we assume 
that the external field vanishes, thus we neglect the second term: in fact, this is a one-body term, 
which is simple to deal with. In the following, Hn{<j, J) has to be interpreted as Hn(o~, J, 0). 

For this model, the investigation of the free energy and its decomposition via Hamilton- 
Jacobi technique or in terms of a cavity function and the energy can still be performed, but the 
simple mathematical treatment of the SK, ultimately due to the second order nature of its phase 
transition allowing expansions in small overlaps, is lost whenever p > 2 because the transition 
becomes first order. 

This is an interesting remark because, when using the replica trick, the p-spin models are 
always thought of as simpler cases. This has a deep physical counter-part: the covariance of the 
Hamiltonian is given by the overlap to the power p, so, for example the SK Hamiltonian has 
covariance ~ Nq 2 , while a generic p-spin model has a covariance ~ Nq p . Of course, as the overlap 
is bounded by one, this means that by increasing the order of interactions p, these correlations 
become more and more negligible until, in the limit p — > oo, one recovers an uncorrelated model, 
i. e. the Random Energy Model [14J. The latter is analytically solvable without either replica 
tricks or cavity field techniques. 

Through a direct calculation (by applying Wick theorem), we can check that the normaliza- 
tion of the Hamiltonian ensures a correct volume scaling for the energy such that 

lim (-H N (a,J)/N) <c£l. 



All physical information is encoded in the free energy density /(/3) = limAr_ s>00 /at(/3). 

Definition 2. The free energy density /tv(/3) at finite volume N, which is a function of the 
inverse temperature (3 = 1/T, is defined as 

M/3) = -^ElogZ N ((3,J) = --L-Elog^e-^^), (2) 

where is called the partition function and E stands for the expected value with respect 
to all the J's. As usual, the sum is over the 2^ configurations a = {o~i, 02, <Jn} of the spins. 
Sometimes it is more convenient to deal with the "pressure" 

a((3) = lim d^ifi) = lim — /3/jv(/3). 

N— >oo JV— »oo 

These are the so-called quenched free energy /pressure, where the disorder is "frozen" and which 
are more difficult to compute than the annealed ones, where the expectation is taken directly 
in the partition function. Using the property EexpAz = expA 2 /2 valid for a standard random 
variable z, the computation of the annealed free energy density is in fact straightforward: 
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Lemma 1. The annealed free energy density is given by 

- Pf A {p) = lim 1 log EZ N tf, J) = log 2 + /3 2 /4. (3) 

JV— >oo IV 

We notice that when f3 is sufficiently small, namely at high temperature, this result coincides 
with that obtained for the quenched average. Physically speaking, when the temperature is 
high enough, spins are no longer correlated and averaging the disorder directly in the partition 
function (which in some way means that it participates to thermodynamic equilibrium) and then 
taking the logarithm is the same as averaging logZ/v. 

Definition 3. If F(cr) is a (real-valued) physical observable, we denote the Boltzmann average 
with 

u(F(a)) = (1/Z N ((3, J)) Y, H°) exp(-/3H N (v, J)). (4) 

a 

This can be generalized by considering two or more independent replicas of the system with 
the same disorder, so that if F(o~, a') is an observable depending on the configuration of two repli- 
cas a, a', its Boltzmann average is Q(F(cr,a')) = J)) J2 a Yla' F{cr, a') exp(— (3H(a) — 
PH(a')). Notice that, even if we did not write it explicitly, w depends on the disorder J, too. 
We denote the average over the disorder with brackets: {F(o~, a')) = E Q(F(o~, o~')). 



3 Thermodynamic limit 

The quantity one is typically interested in is actually the thermodynamical limit of the quenched 
free energy 

/OS) = lim f N (P). (5) 

N— >oo 

Guerra and Toninelli first were able to find out a mathematical strategy to prove the existence of 
the thermodynamic limit for these frustrated systems [22, 21J, which, for the sake of completeness, 
we briefly outline: 

Theorem 1. The thermodynamic limit of the free energy density exists and it is equal to its 
infimum 

lim f N (p) = inf ( --Le log Z N (/3, J)) . (6) 



N^oo N \ (3N 

Proof. Let us consider two separated systems, one constituted by N elements and the other 
one by two independent subsystems (labeled by 1 and 2) with N = N\ + N2 elements. The 
Hamiltonian and free energy density for the first system correspond to expressions (p}, ([2]), 
while for the second system, indicating with c^ 1 ) and the two subsets {o"i, cjVi} an d 
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{<7jv 1+ i, (Jn}, we have an Hamiltonian 



H Nl (a^,J')+H N2 (a^,j") = "J^T £ ^...^u-^ (7) 



l<il<...<i p <Afi 



£ 4L.i P Cr n- Cr ip' ( 8 ) 



V 2/V p_1 

V ^ JV 2 ATi<u<...<i P <Af 

where the J' and J" are distributed as the J, and an extensive free energy given by 

Elog£exp(-/3^ J v 1 (a«, J')) +Elog£exp(-/3# JV2 ( C T( 2 \ J"))- (9) 

O-(l) O-W 

Let us introduce a new fundamental quantity, called overlap, which measures the correspondence 
between two configurations of spins belonging to different replicas of the system 

Definition 4. The overlap q aa i between two configurations a and a' is defined as 

N 



q*o - 

i=i 



In the same way, we define overlaps for the two subsystems 1 and 2 making up the second 
system as 



1 i=i 

2 i=JVi+l 

Choosing a proper free energy, which for t G [0, 1] interpolates between the free energies of the 
two systems presented before, 

^Elog Z N (t) = -^Elog^exp [pV~tH N (a, J) + pVT^t(H Nl {a^\ J') + H N2 (a^ 2 \ J')) 

(13) 

we can easily compute its derivative with respect to the parameter t: 

j t ±Eio g z N (t) = - ^(( q Uy )t - , (14) 

where (.)t is the average over all the disorder J, J' , J" of the generalized interpolating Boltzmann 
state. Since the function q — > q p is convex for even p, and 

a , - + ^k ( 2 ) (15) 
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the derivative of the interpolating free energy is always non-negative 

~ElogZjv(t)>0. (16) 

Integrating this equation between and 1, it is straightforward to show that the thermodynamic 
pressure is superadditive: 

Na N (p) > Nxa Nl (P)+N 2 a N2 (P)- 

Hence, being a(/3) = — /3/(/3), the quenched free energy is sub-additive in the system size. By 
noticing that it is also limited, e.g. by its annealed value a(/3) < log 2 + /3 2 /4 (see eq.([3])), the 
existence of its thermodynamic limit is shown, mirroring the original scheme by Guerra and 
Toninelli [22]. □ 



4 First approach: The Hamilton-Jacobi technique 

We now consider the analogy between the p-spin glass model and the a proper mechanical 
system, obeying a certain Hamilton-Jacobi equation. Interestingly, the potential in this equation 
is related to the fluctuations of the order parameter for the corresponding thermodynamic system. 
As we will see, neglecting this potential we will be able to reconstruct the free energy density for 
the original model. 

To this aim, let us consider the interpolating partition function, depending on the non- 
negative parameters t and x (which symbolically may be thought of as a fictitious space-time 
continuum): 

z N {t, x )=Y J ™v[\J^U E ^...^i-^ + v^(|Q p - 2 (/3)) 1/4 E J ^) • 

a y ti<...<tp i I 

The Jj's are independent random variables, with the same distribution as the J%^...i v , and repre- 
sent an external random field, while Q{(3) is a regular function of /3, which we will later identify 
with the average overlap between two replicas of the system endowed with the same disorder. 
Note that we omitted to write explicitly the dependence of Zfq on /3 and on the J's and we will 
refer to the free energy both at finite size and in the infinite volume limit when there is no danger 
of confusion. 

We may consequently define an interpolating free energy as 
Definition 5. The interpolating free energy density is defined as 

a N {t,x) = —E\ogZ N (t,x), (18) 

where the expectation E is taken with respect to all the J's, that is with respect to the 
mutual interactions between spins as well as on the external random fields. It is immediate to 
see that the true physical free energy is obtained by taking t = [3 2 and x = 0, so our strategy will 



6 



consist in computing the interpolating free energy (|18p and obtaining the statistical mechanics 
by choosing the right values of the parameters t, x. 

We may now proceed to compute the derivatives of a with respect to the parameters. With 
an integration by parts, and neglecting terms which are unimportant in the thermodynamic limit, 
we obtain the following 

Lemma 2. The derivatives of a(t,x) with respect to the parameters t,x are 

dta(t,x) = (19) 
d x a(t,x) = ^(|Q p - 2 (/3)) 1/2 (l-(w)t,x), (20) 

where the generalized brackets {.)t,x ar e meant to weight the observable with the generalized 
Boltzmann factor implicitly defined in eq. (|17p . 

We then define a new function, which will play the role of the bridge with a "mechanical" 
description. 

Definition 6. The Hamilton principal function S(t,x) is defined as 



S(t,x) = 2a(t,x) - x\%Q p - 2 (P) ' -- l + (^-l)Q p (/3) . (21) 



.2 



1/2 t 



2 



V 



2 



The derivatives of S(t,x) are immediately deduced by (|19|) and (|20|): 

1 / p \ (P 1 



d t S(t,x) = --(qP ff ,) ttX -lZ--\QP(p), (22) 

d x S(t,x) = -(|<^- 2 (0)) 1/2 <<W>t,x. (23) 
Lastly, we introduce a proper potential. 

Definition 7. The potential V(t, x) for the mechanical problem is defined as 

V(t,x) ee I ((ql a ,) t>x - QPtf)) + I (gP(0) - Q^ a (^)(w>y • (24) 

With these definitions we are now able to formulate our problem (solving the thermodynamics 
of the p-spin model) suitable mechanical model. 

Proposition 1. The Hamilton principal function S(t,x), together with the potential V(t,x) 
satisfies the Hamilton- J acobi equation: 

8 t S(t, x) + ~{d x S{t, x)) 2 + V(t, x) = 0. (25) 
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Now we assume that the variance of the generalized overlap vanishes 

(qla'kx = (<W>?,* (26) 

and make the identification 

<<w}t,* = Q03). (27) 

These assumptions are very important as they imply, in statistical mechanics, the self-averaging 
property for the order parameter. Despite we assume them and not prove them, we simply note 
that, in order to keep finite the potential V(t, x), even in the p — > oo limit (which is the interesting 
case of the random energy model), the expression in the brackets of the second term at the r.h.s. 
of eq. (|24p must vanish, hence recovering our assumption. Under these hypotheses, within the 
mechanical analogy we are developing, the two terms of the potential V(t, x) vanish allowing 
the system to a free motion, and the corresponding solution S(t, x) is related to the so-called 
replica-symmetric (RS) free-energy, which is the approximation of the free energy density /at(/3) 
obtained by neglecting overlap fluctuations. 

This phenomenology, as it is based on free-field propagation, gives straight lines as equations 
of motion: 

x(t) = x -(^Q^)ft, (28) 

where xq is the starting point. When x = and t = /3 2 (namely, in the point recovering the 
standard statistical mechanics framework) we get 

*o = /3 2 (|Q p (/?)) 1/2 . (29) 
The trajectories (|28p do not intersect, as stated in the following theorem. 

Theorem 2. Given a generic point (x,t) with x > 0, t > 0, there exists a unique xo(x,t) such 
that 

x = x (x, t) - (qaa>)a,x (x,t) t, (30) 
and a unique q(x,t) = (qaa')o,x (x,t) such that 



q(x, t)= J ^=e~ z2 / 2 tanh 2 z (f^ 2 ) ^ yjx + q{x,t)t 



(31) 



The proof is based on the fact that the point t(xo) at which the free trajectory intersects the 
t-axis is a monotonous function of the starting point xq, and can be found in |20| . where the SK 
case is studied in detail. 

The Hamilton- Jacobi equation admits both an Hamiltonian H(t, x) and a Lagrangian L(t, x) 
description, being respectively 

«(*,*) = k^^rf + v{i ' x) ' (32) 

L{ux) _ um^_ nttxy (33) 
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As we are working in the assumption of zero potential, they both correspond to the kinetic energy 
only: 



Definition 8. The kinetic energy T(t, x) is given by 



T(t,x) 



\(d x s(t,x)) 2 



(34) 



This definition allows the following proposition: 



Proposition 2. The solution S(t, x) of the Hamilton- J acobi problem \25}) for V(t, x) = is 
obtained by taking the function S(t,x) in one point (e.g. at time t = and space x = x$) and 
adding the Lagrangian times t (strictly speaking it should be times (t — to) but we choose to = 0). 



5(t, x) = 5(0, s ) + L(t, x)t = 5(0, s ) + T(t, x)t. 



(35) 



Remark 1. The freedom in the assignation of the Cauchy problem plays an important role as, 
by choosing to = 0, we are left with a one-body problem in the calculation of the starting point 
and all the technical difficulties are left in the propagator which, at the replica symmetric level 
(e.g. V(t,x) =0), simply reduces to the kinetic energy times time. 



From (I35p and (I21J . we obtain the corresponding expression for the generalized free energy 
a(t,x) in the replica symmetric approximation (RS). 



a(t, x) = q(0, sq) 



\x (|Q p - 2 (/3) 



1/2 n 1 n-a t 

+ ^(/3)t+-sQV (/ 3) + - 



1 + 



1 W) . (36) 



Now it is easy to obtain the physical free energy, since the free energy for t = does not contain 
the interaction and may be computed straightforwardly 



a(0, s ) = log 2 + 



dz 



e z I 2 log cosh 



(|Q p - 2 (/3) 



xqz, 



(37) 



so that, using (|29p . we finally find the expression for the physical (RS) free energy as stated by 
the next theorem. 

Theorem 3. The replica symmetric free energy 6t{f3) of the p-spin model, obtained under the 
assumption of zero potential V(t, s) in the mechanical analogy, is encoded in the following formula 
(which must be extremized over the order-parameter): 



a(P) = log 2 + 



dz 



e z I 2 log cosh 



+ ^[l + (p-l)QP((3)-pQP~\f3)]. 



(38) 



This represents the RS free energy, which corresponds to the true free energy only for suf- 
ficiently small values of j3 |24| . In fact, assuming a vanishing potential corresponds to neglect 
overlap fluctuations, and the overlap may be identified with a single value (RS approximation) 
only for high temperatures. 
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Proposition 3. Dealing with the overlap, which is related to the initial velocity of the me- 
chanical system, we obtain the following viscous Burger equation which encodes the standard 
self- consistency procedure of the statistical mechanics counterpart 



(9. 



era' / 0,:ro 



Q{P) 



dz 



-z 2 /2 



2vr 



tanh 



V 1 \ V2 



(39) 



Note that the correct SK Replica Symmetric free energy and self-consistence equation are 
recovered for p = 2, and both equations predict in this case a phase transition for (3 = j3 c = 1. 
Above this value the Replica Symmetric solution ceases to be valid |15| . 

It will be useful for a comparison among results gained within this technique and the next 
one, to have a polynomial expansion through Q(/3) of the expression (|38|). hence getting 



a(J3) ~ log 2 + + ^(p - i)QP {P ) - ^pQ^-V + 0(Q 2 ^) 



(40) 



4.1 Extension to the Broken Replica Symmetry scenario 

We now extend the technique presented before to the case of one step of broken replica symme- 
try, which is known to broaden the correctness of the solution to values of f3 higher than those 
required by the previous approximation |15j . In general, it is possible to consider even several 
steps of broken symmetry, and in fact in the case of the SK model the free energy for /3 > (3 C = 1 
is obtained in the limit of infinite iterative steps (this is the so-called full RSB or oo-RSB scheme 
|24|). For higher (3 a broken replica phase is the correct solution even in the case of p > 2, so 
we want to investigate deeply even the mathematical architecture beyond the preserved replica 
symmetry. Following the approach of |20[ I10j . we see that in order to account for breaking of 
this symmetry in our mechanical analogy, we have to enlarge our fictitious space-time by one 
extra spatial dimension for each step of replica symmetry breaking that we want to consider. 
To this task, let us introduce the recursive generalized partition function Z^(t; x\, xk), de- 
pending on the non- negative real parameters t and Xi, ...,xk- 



Z N (t;xi, ...,x K ) = ^2 



exp 



tp\ 



2NP- 



E 



Jii,...i p °~if-°'ip + 



Kil<.. .<i v <N 



K 

E 

a=l 



1/4 

8=1 



(41) 

Here, as before, the Jf are independent random Gaussian variables with zero mean and unitary 
variance, and we denote by E a the expectation with respect to all the Jf for i = 1,...N. The 
Q a {P) ar e regular functions of j3 which may be identified with the values around which the 
overlap distribution accumulates, and they are ordered in the interval [0, 1]: 



= Q (I3)<Q 1 (I3)<...<Q K (P)<1. 



(42) 



We denote the Boltzmann-Gibbs state associated to this partition function with £>(.), and 
observe that the physical model is recovered by choosing t = j3 2 and x a = for a = 1, K. 
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Given the K + 1 ordered real numbers within the interval [0, 1], the typical nested structure 
of the broken replica symmetry is encoded in the generalized partition functions Z a , defined 
recursively as 

Z a =(E a+1 Z^) 1/ma+ \ (43) 

with Zk = Zn and Zq = exp(Ei log Z%). Note that this last definition is obtained by the general 
one (|43p in the limit of mi — > 0. The number K of parameters x a (dimensions of our fictitious 
space-time) are then related to the number of steps of broken symmetry. 
It is useful to define the quantities 

Z ma 

fa = E a Z™ a ' ^ 

which are all non-negative and not greater than one, and share with the Z a the property of 
depending on the random fields J\ only with b < a. 

With these definitions we are now able to introduce the new states. 

Definition 9. The generalized Boltmann-Gibbs states are defined as 

w B (.) = E a+1 ...E K (f a+1 ...f K u(.)), (45) 
oj k {.) = w(.). (46) 

Again, it is possible to define Boltmann-Gibbs states Q a for replicas of the system and, lastly, 
introduce the averages: 

(.) a = EoEi...E (/i.../ S2 (.)). (47) 
We now introduce the generalized free energy a(t]X\, ...,xk) mirroring the previous section. 

Definition 10. The generalized free energy associated with the partition function Zq is defined 
as follows: 

a(t; Xl ,...,x K ) = ^E logZ = ^EoEibgZi. (48) 

We want to use this expression to write down a proper Hamilton- Jacobi equation, generalizing 
eq. (|25p and find the physical free energy in this enlarged space. To this aim, we need the 
derivatives of the generalized free energy with respect to the interpolating parameters, whose 
cumbersome computation is reported in the appendix. 

Lemma 3. The derivatives of the generalized free energy with respect to the interpolating pa- 
rameters are given by 



d t a N (t;xi,...,XK) = -g 



K 



^2(m a+1 -m a ){q p aa ,) a 



a=l 



(49) 



d 1 fp _o \ 

aN[t;xi,...,XK) = d a a N (t;xi,...,x K ) = -y-Qa {p)j 



dx a 



K 

^(m fe+ i - mb){q a <T>l&p) 

b=a 
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where we recall that 

(q P aal ) a = E E 1 ...E a (fi-fan a (q P aal ))=E E 1 ...E a Ul-faj^ £ ^ a (a h ...a ip ) J . (51) 

We are now ready to introduce the proper Hamilton principal function in this generalized frame- 
work. 

Definition 11. The Hamilton principal function is defined as follows 



i+(^-i)E( m "+i- m «)W) 



S^xi,...,^) = 2d(t;xi,...,x^)-^x a (-Q£ 2 {f3) ^ 

" L ~ ' a=l 

(52) 

Using (|49[ l5"Uj) we may easily compute its derivatives 

K , , h 

(53) 



1 K ( 1\ K 

d t S(t; Xl ,...,x K ) = --J2( m a+i -m a )(^ a ,) a - (7-2) 5Z( m ^ 

a=l ^ ' a=l 



1/2.*' 



5 a 5(t;xi 5 ...,a?K) = - 2 (/?)) ' ^(m b+ i - m b )(q a 



b=a 



and write down the Hamilton- Jacobi equation which implicitly defines the potential V(t; xi, xk) 
to whom our auxiliary mechanical system is subject: 



1 K 

d t S(t;xi,...,x K ) + - d a S(t;x 1 ,...,x K )xM ab 1 xd b S(t;x 1 ,...,x K ) + V{t;x 1 ,...,x K ) = 0. (54) 



a,b=l 



Here M 1 is the inverse of the mass matrix, which we are going to define in a convenient way 
through the kinetic energy T(t;xi, ...,xk)'- 



Definition 12. The kinetic energy is defined as 

K 

2 



T(t;xi, ...,x K ) = - ^2 d a S(t;x 1 , ...,x K ) X M^ 1 x d b S(t;xi, ...,x K ). (55) 

a,b=l 

Using (I53p . T(i; xi, xk ) may be written as 

k if jc 

T(t;xi, ...,x K ) = - } ^ (M )ab[Qa\P)Qb(P)] 2 Z^Z^( m c+i - m c )(q aa/ ) c (m d+1 - m d )(q aa/ ) d 

a,b=l c>a d>b 

K 

= 7 D cd (m c+ i - m c )(q aa ') c (md+i - m d )(q aa/ ) d , 

c,d=l 

(56) 
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where we introduced the matrix D, whose generic entry is defined as 

c d 



l(j»-2)/2, 
o=l 6=1 

To decouple the overlaps (q a a')c an d {q a a')d we now pose 

D c ,(m c+ i - m c ) = 5 ed Qjr 2)/2 Wt' 2)/3 iPl ( 58 ) 
where e) cc ; is the Kronecker delta, and then 

K 

T(t;xi,...,x K ) = j^2(m a+ i - rn a ){q acjl )lQ p ~ 2 {P). (59) 



a=l 



Definition 13. Within this mechanical analogy, the potential V(t;xi, Xk) is, again, directly 
related to the fluctuations of the overlaps and can be introduced as follows: 



1 K 

V(t; Xl , ...,x K ) = - ^(m a+1 - m a ){(q p aa ,) a - QgO?) + \ [Q P M - {q^lQl' 2 {?)]}■ (60) 



a=l 



The condition (j58|) completely determines the elements of M . These are all vanishing 
except on the diagonal and the terms whose indexes differ only by one, which are symmetric: 

= _!_ + _!_(<W« r 2 > 2 , 

m a+ i-m a m a - m a _i \Q a +i{p) ) . , 

1 fQM\ (p - m 



(m~ ) aa+ i = (m ) ao+ i = Tpyk a ^ 2 ' 

m a+ i - m a VQa+i(p)/ 
and with 

(M- 1 )!! = — . (62) 

7712 

The matrix M _1 clearly admits an inverse, its determinant being non-null: 

K+l 

det M -1 = JJ (m a - m a _i) / 0. (63) 

a=2 

Notice that the elements of M and consequently M depend on the overlaps q a , differently from 
the case p = 2 |10| . In this case, in fact, the system energy is no longer a quadratic form in the 
overlap averages, and this has deep physical consequences; in particular, the phase transition is 
first order for p > 2, meaning that the order parameter changes discontinuously at the critical 
temperature. 
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4.2 The first step of broken replica symmetry 

Using results from the previous section, here we find out the expression of the free-energy corre- 
sponding to the first step of broken replica symmetry (1-RSB). 



Definition 14. The generalized partition function and free-energy are defined as 

,p 

:2 



Z N (t;xi,x 2 ) 
a N (t;xi,x 2 ) 



^exp 

<7 

1 



tp\ 



2NP- 



- 2 l , A N 



Nm 



l<i\<...<i p <N 

E Q EilogE 2 ^, 



0=1 



4=1 



(64) 



where we took m 2 = m and we remind that in this case 

Z 2 = Zn, 
= Qotf) < Qi(p) < Q 2 (/3) < 1, 
= mi < m 2 < 1 = 7713 . 



(65) 



The principal Hamilton function S(t,xi,x 2 ) can be introduced as 

Definition 15. The principal Hamilton function for the associated 1-RSB mechanical problem 



is 



S(t, Xl ,x 2 ) = 2a(t, Xl ,x 2 ) - (|QT 2 C9)) 1/2 xi - (|QT 2 C9) 



1/2 



X 2 



t 

2 L 



1 + 



l)(mQ?(/3) + (l-m)Qf(/3)) 



(66) 



As shown in the general case in the previous sections, we must now evaluate its derivatives 
d t S(t,x u x 2 ) = -imfokh - ~(1 - m)(^>2 - - ^) + (! " ™) W)), 



hS{t,x u x 2 ) = -m (|QT 2 C9)) <<W>i - (1 - m) (f Of" 2 ^)) <<w) 

a 2 5(t,x!,x 2 ) = -(i - m) (|gr 2 (/?)) 1/2 <<w>2. 



(67) 



Proposition 4. Choosing the inverse of the mass matrix (and so the mass matrix itself with the 
condition \58\) ) 



M~ 



i_ 

m 



_J_(-Qi\(p-2)/2 
m\Q2> 



J_(-Qi\(p-2)/2 _J , i./Ql' 

m^Qo' 1—rn m v Q2 



p-2 



M 



m + (l-m)(gi)P- 2 (1 -m)(gi)(P- 2 )/ 2 
(1 _ m )(gi)(P-2)/2 !_ m 
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we can write down explicitly the kinetic term T(t;xi,x 2 ) and the potential V(t;xi,x 2 ) of the 
equivalent mechanical system: 



T(t; Xl ,x 2 ) = \m{ q ^)\Q p -\p) + |(1 - m) {q^lQ^ 2 (/?) , 



1 



(68) 



1 



f ±(1 - m) [(q p aa ,) 2 - Q p 2 (f3) + |(Q505) - <<w>^r V)) 



We can consequently state the following 

Proposition 5. There is a mechanical analogy between the 1-RSB statistical mechanics of the 
p-spin-glass and an equivalent mechanical system that moves in a two-dimensional space-time 
with equations of motion given by 



x\(t) = x\ + v\(t; x\,x 2 ) t, 
x 2 (t) = x° + v 2 (t; xi,x 2 ) t. 



(69) 



The corresponding velocities are defined as 

2 



vi(t;x u x 2 ) = Y,( M ~ V )iad a S{t ]Xl ,x 2 ) = - ggP~ 2 (/3)) 1/2 (q^,), 



a=l 
2 



v 2 (t; Xl ,x 2 ) = ^2(M 1 ) 2 ad a S{t;xi,x 2 ) 



a=l 



{Qaa')l ~ Q 2 (P){q*a')2- 

(70) 



As discussed before, we are interested in studying the free motion, i.e. the motion in absence of 
potential, and deduce the physical free-energy from the solution of the Hamilton- Jacobi equation 

1 K 

d t S(t;x x ,x 2 ) + - ^2 d a S(t; Xl ,x 2 ) x M ab 1 x d b S(t;x 1 ,x 2 ). 

a,b=l 

We stress that here the potential is related to a more complex kind of fluctuations of the overlap as 
we are requiring much more than the simple self-averaging: Physically we can think at each step 
of RSB as a refinement, a zoom, in the analysis of the free energy landscape, that allows to see 
rugged valleys otherwise averaged out and we are asking for adiabatic thermalization within each 
of these (sub)-valleys ("sub" w.r.t. the macro-ones already encoded in the RS-approximation) . 
Coherently, a sufficient condition for a vanishing 1-RSB potential is an overlap variance inside 
the bracket denoted with (.) equal to zero and the identification of the averages of the overlap 
with the functions Q a (P)- 



(Q 2 *<r>)a={qv<r>)l = Ql(f3), a = 1,2. 



(71) 
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In the absence of a potential, the velocities (and so the kinetic energy) are conserved quantities 
and we can then consider their values at the initial instant t = 0, in perfect analogy with the RS 
case: 

_ f \jdfi(z 2 )cosh m e(z 1 ,z 2 )tanh9(z 1 ,z 2 )] 2 

Qi = <W/i (0;si,x 2 ) = d^{zi) . — — r , 

J L J dfj,{z 2 ) cosh 9(z 1 ,z 2 ) 

__ /■ rd/x(z 2 )cosh m 6l(zi,22)tanh 2 6i(zi,Z2) ( 72 ^ 

za) = (|qt 2 ) 1/4 ,1 + 75 (|gr 2 ) 1/4 

where 9 will be defined in eq. (|75l) and 

d|u(z) = exp(-z 2 / 2 )d2 (73) 



is the Gaussian measure. This computation essentially leads us to the 1-RSB self-consistence 
equations for overlaps when considering the statistical-physics point t = (3 2 , x\ = x 2 = 0. In this 
point, and with the condition (|7ip . the equations of motion (|69p give 

4 = ? (|W)) 1/2 , 

^^ 2 (|) 1/2 qI(^)-^(1) 1/2 &> (74) 

V2/ V2/ Q 2 2 (/?) 

so that the explicit self-consistence equations contain 

9(z u z 2 ) = (3 (f) V2 ziQpl/?) + /? (|) V2 z 2 ^0 p 2 - 1 W) ~ (75) 

Remark 2. 7n f/ie second term of the r.h.s. of equation 175]) f/ie fiuo overlaps are decoupled, and 
in the limit p — > 2 we <?e£ t/ie correct 1-RSB self- consistence equation for the SK model too. 

To compute the free-energy we use the usual recipe: As we assume that the mechanical 
potential is zero, we write (easily) the solution for the Hamilton-Jacobi problem and then we 
evaluate it in the point t = f3 2 ,x a = 0. First of all, we need the free-energy at the initial instant, 
which is straightforward to obtain, since it contains no spin interactions: 

a{Q;x\,xl) = log 2+ -j- y d/i(zi)log J dfi(z 2 ) cosh m 9{z x , z 2 ), (76) 

with 6(zi,z 2 ) given by (|75p . The Hamilton function which is solution of (|54p for a vanishing 
potential V = is simply given by the function at the initial instant plus the integral of the 
Lagrangian, (which corresponds to the kinetic energy only), over time 



S(t; Xl ,x 2 ) = S{0;x° 1 ,x° 2 )+ [ dsT(s; x x ,x 2 ) = 5(0; < x° 2 ) + T(0; x\, x%)t, 

Jo 



(77) 
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where we used the fact that the kinetic energy is a conserved quantity. We obtain in this way 



S(t-x x ,x 2 ) =20(0;*?,*°) - (foT 2 (/?)) ^ *? - (foTV)) 



1/4 



x 2 



+ |o?09) + |(l-m)O§0?), 



(78) 



and from this, the generalized free-energy a(t;*i,*2) 
a(t;*i,x 2 ) =^5 , (t;*i,x 2 ) + ^ (|<3?~ 2 (/3) 



1/2 



Xi + 



l (lnP 



Q p 2 - 2 (P)) 1/2 x 2 ) 



2 V2 



1+ (f -l) (mQlW) + (l-m)Q P M) 



(79) 



Then the physical free-energy is easily computed by taking t = /3 2 , x\ = x 2 = Q and we can state 
the next theorem: 

Theorem 4. Making the assumption of vanishing potential V(t,xi,x 2 ) in the mechanical anal- 
ogy, the corresponding free energy for the p-spin glass model corresponds to the so called "1-RSB" 
and is given by 

atf) =log2 + 1 f dn{zt) log f dfi(z 2 ) cosh m {j3ziQ < f~ 1)/2 (f3) + /3z 2 yJ Q^iP) - Q? -1 ^)) 



+ 



/3 2 



1 + (p _ i) m Qj(/3) + (p - 1)(1 - m)Q p 2 (P) - P Q\-\P) - pQt'ifi) 



(80) 



We skip here any digression on the physics behind these formulas as these are in perfect 
agreement with the original investigation by Gardner |15j and by Gross and Mezard [18j, so to 
highlight only the mathematical methods, to which this paper is dedicated. 



4.3 Conservation laws: Polynomial identities 

We conclude this section with an analysis of the conserved quantities deriving from the internal 
symmetries of the theory. We will approach them as Nother integrals within the Hamilton- Jacobi 
formalism, while at the end of the next section we will re-obtain (and discuss more deeply) the 
same constraints within a more familiar thermodynamic approach. 
Let us restate the Hamilton- Jacobi equation 

d t S(t,x) + H(d x S(t,x),t,x) = 

where the Hamiltonian function reads off as |32| 

H(d x S(t, x),t, x) = T(t, x) + V(t, x). (81) 
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Hamilton equations are nothing but characteristics given by: 



x = v(t,x) 

i = 1 

P = —v(t,x)d x v(t,x)—d x V(t,x) 

E = -v{t,x)d x {d t S{t,x))-d t V(t,x), 



(82) 



the latter two equations display space-time translational invariance and express the conservation 
laws for momentum and energy for our system, further, these can be written in form of streaming 
equations as 

DP(t,x) = -d x V(t,x) 
DdtS(t,x) = -d t V(t,x). 



Since we are interested in evaluating the free motion, bearing in mind that v(x,t) 
dtS(x,t) = — !(<Zi2)> so D = dt — (q p / 2 )d x , we conclude 



D(qP' 2 ) 
D(qP) 



0, 
0, 



{q P i2 > and 



(83) 



i.e. 



<<&> - ^Vs 72 ) + z(4 2 4i 2 ) 

<flS>-4<<&<&>+3(^> 



0, 
0. 



(84) 



Remark 3. The orbits of the Mother groups of the theory coincide with the streaming lines 
of the Hamilton- J acobi Hamiltonian, and conservation laws along these lines give well known 
identities in the statistical mechanics of the model often known as Ghirlanda-Guerra relations 
and Aizenman-Contucci identities 

We will deserve Sections VC and VD of the paper to deepen our understanding of these 
identities within the smooth cavity field approach, hence we do not investigate them further 
here. 



5 Second approach: The smooth cavity field. 
5.1 Smooth cavity field and stochastic stability 

The main heuristic idea of the cavity field method is to look for an explicit expression of a(/3) = 
— /3/(/3) upon increasing the size of the system from N particles to iV+1 (originally the technique 
was developed by removing a spin instead of adding, hence "cavity", but we will follow the 
approach recently developed in [7]). As a consequence, within this framework attention will be 
payed at the system size and all the N dependencies will be explicitly introduced. 
On the other hand, in order to formulate stochastic stability, we have to consider the statistical 
properties of the system with a Hamiltonian given by the original Hamiltonian H plus a random 
perturbation H so to write H' = H + eH. Stochastic stability states that all the properties 
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of the system are smooth functions of e around e = 0, after the appropriate averages over the 
original Hamiltonian and the random Hamiltonian have been taken. We stress that, even though 
initially it was only postulated [6j, stochastic stability has recently |12j been rigorously proven 
for a wide class of disordered Hamiltonians. 

Our idea, to be explored in detail later on, is that for a system with a gauge-invariant Hamilto- 
nian (like the even p-spin model at zero external field) we can choose, as generic random perturba- 
tion H in the stochastic stability approach, a term proportional to <i p -i Jii,...,i P -i a ii---°'ip-i' 
Here the Ji 1> ... ! i p _ 1 are random fields, taken from the same Gaussian i.i.d. distribution as the orig- 
inal Ji lt ... t i p . The key insight is that this is a "hidden" cavity field: by applying the transformation 
cr, — > Oi<7 n+1 Vi (which leaves the Hamiltonian H invariant) it is possible to switch the stochastic 
stability approach into the standard cavity field approach. As we are going to see, this technique 
offers more freedom than the two single, non interacting, approaches as we can turn one into the 
other as desired. 

To explain the method we need some preliminary definitions. First, let us introduce an 
extended partition function that includes an interaction with an added hidden spin crjv + i through 
a control parameter t £ [0, f3 2 ] such that for t = we have the classical partition function of N 
spins while for t = (3 2 we get the partition function (times one half) for the larger system, with 
a little temperature shift which vanishes in the thermodynamic limit: 

Z N ((3,t) = e -^M + v^T Ei<i 1 <...<i p _ 1 <w J n,-,yi' J H---%-i _ ( g5 ) 

Indeed, when t = /3 2 , by redefining Ji — > Jj j\r+i an d making the transformation o~i — > crjcrjv+i Vz, 
we obtain the partition function for a system of N + 1 spins at a shifted temperature j3* such 
that 

p-i 

(3* = p((N+ 1)/Nj 2 ^/3forA^oo. (86) 

The only other, trivial, difference is that of course the sum over (Jn+i in the partition function 
for N + 1 spins gives an additional factor 2. 

Next, we state the two key symmetries whose breaking we will be concerned with. These 
apply to the unperturbed (t = 0) system; recall that (.) = Ew(.). 

Proposition 6. The averages (■) are replica-symmetric, i.e. invariant under permutation of 
replicas. In other words, for any function F s ({q a b}) of the overlaps among s replicas and any 
permutation g of s elements, (F s ({q ab })} = {F s ({q g{a)g{b) })) . 

Note that there is no issue with replica symmetry breaking here, as we are concerned with 
real replicas. 

Proposition 7. The averages {■) are invariant under gauge transformation, i.e. for any assign- 
ment of the e a = ±1 we have 

(F s ({q ab })) = (F s ({e a e b q ab })) . (87) 
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This second symmetry is a consequence of the fact that the Hamiltonian (in zero field) is 
even in the spins, i.e. it remains unchanged when we transform af — > e a af. 

Next we will formalize some terminology and concepts which will be useful for developing our 
smooth version of the cavity method. 

Definition 16. We define as "filled" a monomial of the overlaps in which every replica appears 
an even number of times. 

Definition 17. We define as "fillable" a monomial of the overlaps in which the above property 
is obtainable by multiplying with exactly one two-replica overlap. 

Definition 18. We define as "unfillable" a monomial which is neither filled nor fillable. 



Polynomials that are sums of filled monomials will themselves be called filled, etc. We give 
a few examples: 

• The monomials q\ 2 and q\ 2 q^ A are fi ne d (as p is even by definition). 

• The monomial q± 2 is fillable: multiplication by q\2 gives the filled monomial q\ 2 . Similarly 
q^Q^ 1 is fillable: it is filled by multiplication with 534. 

• The following monomials are unfillable: qf 2 q^ , q\2Q23Qi5- 

Now the plan to gain information on the p-spin-glass free energy as follows: First we define 
the cavity function and we prove some properties (related stochastic stability) of the classes of 
overlap monomials defined above. Then, we show that the free energy can be written as the 
internal energy plus the cavity function, and lastly, we expand the cavity function through the 
overlap monomials. Merging all together we have an irreducible expression of the free energy in 
terms of overlap monomials (which physically correspond to overlap correlation functions). 

Definition 19. We define the cavity function ty]\[((3,t) as: 

z N (P,t) 



y N (P,t) =E[lnw(eV» rTEl ^ < - < Vi< wJ, i-vi' T 'i-Vi)] = E 



In- 



Zn(/3) 



Definition 20. We define the generalized Boltzmann state that corresponds to the partition 
function A85\) as: 



»*w = [ j ' (89) 

^(gV 2JVP- 1 2^1<i 1 <...<i p _ 1 <JV ;. l" I 

where F is a generic function of the N-spin configuration a. 
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The next step is to motivate why we have introduced these definitions. We will first state two 
Theorems ([5]and[6|) that show that the filled and the tillable monomials have peculiar properties. 
Monomials in the first class do not depend on the perturbation (i.e. they are stochastically stable) 
while those in the second class become filled (via the t7j — > 0"j<7jv+i gauge transformation) in the 
thermodynamic limit. 

Theorem 5. In the N — > oo limit the averages (Q) of the filled monomial Q are t- independent 
for almost all values of (5, such that 



lim dt(Q) t = 

TV— >oo 



Proof. We will prove the theorem in a key case, namely for Q = g? 2 , and refer to [7] for further 
generalizations. Let us write the cavity function as 



* N {l3,t)=E[\nZ N (P,t)]-E[lnZ N (l3)}, 
and take its derivative with respect to /3 (writing again (.)t = Eo;t(.)), we have: 



(90) 



(91) 



We want to show now that the function Tjy(/3, t) = (q^) ~ (#12)* vanishes for N — > oo. From 
eq. ([9T]) we have 

T N {P,t) = -^dp* N {p,t). (92) 
and integrating this in a generic interval [/3i,/3f] gives 

T N (P,t)d/3 2 = ±[q, N ( / 3 2 ,t)-^ N (f3 1 ,t)]. 



0f 



N 



(93) 



To finish the proof, we show that ^^(/3,t) is of order unity. The simplest way to do this is by 
looking at its "streaming", i.e. its variation with t. By a direct calculation one finds 



<M N (l3,t) 
dt 



1 



-E 



1 

N 



uj1(a il ...a ip _ 1 ) 

l<h<...<i p - 1 <N 



1 



(i - <«5 



(94) 



Hence, since (q^ 2 1 }t G [ — 1, 1]> an d with \I/7v(/?;0) = (due to Z^((3,t = 0) = Zjv (/?)), we have 
< ^n{/3, t) < t. Therefore the r.h.s. of (193|) goes to zero for N — > oo, and the same holds for 
the average of Yjv(/3, t) over any small temperature interval (with the exception of singularities). 
Consequently, Tjv(/S, t) itself goes to zero, implying the claimed t-independence of the filled 
overlap monomials {q\ 2 )t — > (^12)- C 
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The next Theorem is crucial for this section, so we first prove a lemma which contains the 
core idea. We temporarily introduce subscripts on the Boltzmann states to clearly distinguish 
the different quantities considered. 

Lemma 4. Let uj^ r{.) and U)j^ r t(-) be the Boltzmann states defined, on a system of N spins, 
respectively by the canonical partition function and by the extended one $85]) . Consider a set of 
r distinct spin sites {ii,..,i r } with 1 < r < N . Then for t = f3 2 , the extended state becomes 
comparable to the canonical state of an N + 1 spin system, in that the following relation holds 

w AW=/3 2 (°u • • • Cir) = w AT+l,/3*Oii • • • 0"j r fJ^ +1 ). (95) 

Note that the r in the last factor is an exponent, not a replica index, so that er^ , 1 = 1 if r is 
even and o~ r N+l = o~n+i if t is odd. 

Proof. The proof is based on an application of the gauge symmetry, i.e. the substitution o~i —> 
(jj(7jv + i. Let us write out explicitly the l.h.s. of eq. (|95p . abbreviating 7r = G{ x ■ ■ ■ o~i r : 



"i^MPfr) = ^— • (96) 

e -/3H N (a,J)+l3^ 2jvp _ 1 Ei<i 1 <...<i p _ 1 <jv J n,-,i p -i CT n 

Introducing a sum over o~n+i into the numerator and the denominator (which is the same as 
multiplying and dividing by 2 because there is no dependence on <7jv+i) and making the transfor- 
mation dj — > 0j0"jv+i; the factor ir in the numerator is transformed into vnT^+i- The exponential 
becomes the extended Boltzmann factor of an (N + l)-spin system at the modified temperature 
(fgg|). so that 

^AW^C 71 ") = VN+i,p*(na r N+1 ) (97) 
as claimed. □ 

Using this lemma, it is straightforward to prove the following theorem, whose proof we omit 
as it is identical to the one shown in [7]. 

Theorem 6. Let Q be a fillable overlap monomial, such that q a bQ is filled. Then for N — > oo 

(Q)t=p = (qabQ), (98) 

where the average on the right is evaluated in the canonical Boltzmann state (t = 0). We will 
refer to this property as saturability. 

To motivate physically why theorem [5] should indeed be true for all filled monomials, let us 
make a clear example: Suppose that such a monomial Q is a function of overlaps among s replicas. 
Consider as before the Boltzmann measure perturbed by a smooth cavity field and call a a the 
N -spin configuration of the replica a. We apply the gauge transformation <7? — >■ cfcr^-^, calling 
cr® = (cr", . . . ,Cjv +1 ) the enlarged spin vector obtained. The key feature of a filled monomial 
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Q is that it is left invariant by this transformation, so that (all sums run over a = 1 . . . s and 
i = 1...N) 



, 4 E{*» N+1 }E{a*}Q(Uab » e 

(Q) t = E- A " ' 



V V p T, a l 3H ( aa )+y 2jvp-i Sii<...<i „_i J n->-i <7 i 1 - (J i „_! 
E _K) ab 

v -E.^M+^r& 1 <...< <f _ 1 J( 1 ..v 1 'f 1 -^i B4 w 



E 



z -— '1°"+} 

with /3* defined as before and 



#+«)- - w 2 fjv + i) P -i E 

V v ; l<ii<. -<i P <N 

~ \ 2(N + 1)p- 1 Ji^.-vi^i-Vi^+i. (100) 

V V ^ j l<ii<...<i p _i<AT V M 

For t = f3 2 we have an iV + 1 spin system at the slightly shifted temperature (3* , and for TV" — > oo 
this will give the same result as for an N spin system at the original temperature up to vanish- 
ingly small corrections: (Q) t= g2 = (Q) + 0(1/N). For generic nonzero i one has in addition a 
modified strength of the interaction of one spin (cr/v+i) with all others. Also, this should only 
give 0(1/ N) corrections because to produce a non- vanishing perturbation one expects that a 
finite fraction of spins should have non-standard interaction strengths. 

As a final ingredient for later developments, let us show the streaming of a generic observable, 
i.e. its variation w.r.t. the parameter t ruling the strength of the smooth cavity perturbation, 
that we state without the proof as it is a long but straightforward generalization of the once 
given for instance in [TJ [2]: 

Proposition 8. Let F s be a monomial of overlaps among s replicas; then for any N the following 
streaming equation for F s holds: 



dt 



l<a<b<s l<a<s 
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5.2 Stochastically stable expansions 

For the sake of clearness, let us outline briefly the plan for this section: first we link the free 
energy, the internal energy and the cavity function (which carries the information about the 
entropy). As we are interested in the free energy and an explicit expression for the internal 
energy is obtained through a direct calculation as 

(H N (a, J)) =-^(1 -(&)), 

our attention is focused on the cavity function: We show that it is possible to represent it in 
terms of filled overlap monomials. These are evaluated initially in the perturbed Boltzmann state 
Ut but because they are stochastically stable according to theorem [5j we can also evaluate them 
in the unperturbed state. Adding the internal energy part then gives us the desired expansion 
of the free energy in terms of overlap correlation functions as stated by the following theorem. 

Theorem 7. Assuming that the infinite volume limit of the cavity function 

#(/M = /3 2 ) = Jim * N {P,t = 2 ) 

is well behaved, the following relation holds in the thermodynamic limit: 

«(/3) + f(P - = ln2 + * (ft t = (3 2 ). (102) 

Proof. Let us consider the partition function of a system of N + 1 spins and at an inverse 
temperature f3*, which is slightly larger than the "true" inverse temperature /3 according to (I86p . 
Then, using the gauge transformation U{ —> <7i<7jv+i in reverse, we get 



/3* VpT j 

Z N+1 (f3*) = e^ N + 1 ) p - i - 1< - <ip - N+11 ip r P 

{cr},cr at+1 

~ 2 ^ev'w 1 ' - 1< "' < '''-'" Jn,...,i P ^i-^p ev / 2 ^_ 1 lui<i 1< ... < i p _ 1 <N J n,-,v-i CT H 



= 22 jV (^(e^ Ll ^ < ^>- 1 ^ • 1 '-' p - lff,1 -'' Vl ). (103) 

Taking logarithms and averaging over the disorder, the last term just becomes the cavity function 
(as the J^jv+i have the same distribution as the Jj in the original definition): 

\Eln Z N+1 (f3*) -MlnZ N+1 (P)) + [Kin Z N+1 (/3) - E\nZ N (p)} 
= ]n2 + * N (P,t = p 2 ). 

The first combination in square brackets on the l.h.s. can now be expanded in the small difference 

(p-i) 



N + l . 
N ' 



(p-D^ + 0(^), (104) 
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according to 

ElnZ 7V+ i(/r)-ElnZ A r +1 (/?) = (p - 1) ^dpEhi Z N+1 (f3) + 0(1/N) 

= (p-l)^d p a N+ i(l3) + 0(l/N). 

The difference in the second set of square brackets will give the pressure a{(3) for large N, and 
taking N — > oo therefore directly gives the statement of the theorem. □ 

Strictly speaking, the existence of the thermodynamic limit is not sufficient to guarantee that 
the free energy increments converge, as assumed above. This technical difficulty can be avoided 
by taking a Cesaro limit (see for instance [9]) rather than a standard limit N — > oo, and the 
large- N value of the cavity function then should be understood in this sense. 
This theorem states that we need to study the cavity function to extrapolate properties of the 
free energy. To do this, let us recall its streaming w.r.t. t, as given in (l94l) : 

= | (1 - (*">.)■ (105) 
Since the cavity function vanishes for t = 0, it can then be written as 

* N (M = lJ*dt'(l-(<f i ; 1 ) t ,). (106) 

The plan now is to expand (q^^t m t, by evaluating successive i-derivatives via the streaming 
equation (proposition [8]). A key insight that makes this expansion possible is that at t = all 
averages of monomials that are not filled must vanish because they would otherwise acquire a 
minus sign under a gauge transformation (Proposition [TJ. 
Applying the streaming equation first to (gf^ 1 )* gi yes 

where we have also exploited the permutation symmetry among replicas. As a consequence, 
because filled monomials do not depend on t in the thermodynamic limit and in /3-average, we 
can write ((?f^ 1 )t ~ (^12)^ + 0(q 2p ), such that the first terms of the cavity function read off as 

*(t = /3 2 ) = £p- ^V{qlt l) ) + Oifgt^). (108) 

Hence, we can write the representation of the free energy in terms of irreducible overlap correla- 
tion functions as stated in the next 

Proposition 9. The leading terms of the free energy of the p-spin glass model are given by the 
following expression in terms of overlap correlation functions: 

a{P) = In 2 + ^ (l + (p - l)(q p ) - ^p(q 2 ^) + 0((q$- l) ))) . (109) 
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Note that this expression coincides with the corresponding expression for the SK model when 
p = 2, in fact in this case (q p ) = (q 2 ^" 1 )) and the coefficient for the second moment, i.e. (g 2 2 ), 
is given by (1 — /3 2 ), which when equal to zero, i.e. at /3 = 1, reverses the concavity of the term, 
implying a second-order phase transition, so that criticality is restored, as expected. 
Note further that this coincides with the expansion (I4U|) of the free energy previously obtained 
with the Hamilton- Jacobi technique. 



5.2.1 Locking of the order parameters 

The free energy expression above has an interesting interpretation if we regard the pressure as 
a function of temperature and of all the averages of filled overlap monomials. To emphasize this 
we write in the following discussion a(/3, (•)) instead of a((3); here (•) refers to the collection of all 
(averages of) filled monomials and we associate to any combination of monomials a graph where 
each node represents a different replica and each link corresponds to an overlap between the 
connected nodes/replicas [7]. We will show that the total temperature derivative of a equals its 
partial derivative; in the latter, the graphs are taken as constant, i.e. their temperature depen- 
dence is not accounted for. This is reminiscent of the situation where a free energy is expressed 
as an extremum over some order parameters, and the first order variation with temperature can 
be found while keeping the order parameters constant. The result we prove shows that the filled 
graphs in our framework behave similarly to such order parameters, even though of course their 
values are not determined via an extremization. 

In order to prove our statement, it is convenient to work with derivatives w.r.t. /3 2 ; of course 
/3-derivatives can be recovered trivially by multiplying by 2/3. From Theorem [7] we have for the 
pressure the expression 

a(/3,(.» =ln2 + M/(/3,t = /3 2 )-^(p-l)a /3 a(/3). (110) 
Its total derivative with respect to /3 2 is: 

Jjpaw, (.)) = 9^ <•» + E ^y^> ( m ) 

where the sum \ runs over all filled graphs. Of course, we already know the value of this total 
derivative as it is proportional to the internal energy: 



^,<.» = ^™ = i(l-<&»- (H2) 



But we can also calculate the partial /3 2 derivative: from (jllOp 



dpa(J3, (.» = dfp9(J3,t = (3 2 ) - ^— ^(1 - <<&»■ (H3) 

To understand how to calculate the partial derivative of the cavity function, where all filled 
monomials are held constant, recall the expression (I109p . We need to substitute t = /3 2 there 
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as we are concerned with *f?((3,t = /3 2 ). The explicit dependence on /3 2 of the result then comes 
only from the prefactors of the filled graphs, i.e. from the original t-dependence of the cavity 
function. The latter is already known (see Eq. f|105j) ) . and so we get 



(114) 



where in the last step we have exploited Theorem [6j Inserting the previous expression into (|113p 
shows that the total and partial derivatives of a are indeed the same, as claimed: 



As a consequence, the second term in the r.h.s. of Eq. (Illip has to be identically zero: 



We will see in section 15.41 how this relates to the well-known polynomial identities that we revise 
in the next section. 

5.3 A digression on Ghirlanda-Guerra and Aizenman-Contucci identities 

In the p = 2 case (namely the paradigmatic SK model |33| ) Parisi went beyond the solution for 
the free energy and gave an ansatz about the pure states of the model as well, prescribing the 
so-called ultrametric or hierarchical organization of the phases (see |24] and references therein). 
From a rigorous point of view, the closest the community has so far got to ultrametricity is in the 
proof of identities constraining the probability distribution of the overlaps, namely the Aizenman- 
Contucci (AC) and the Ghirlanda-Guerra identities (GG) (see [HUT] respectively). These are 
consistent with, but weaker than, Parisi's ultrametric structure, despite recent fundamental step 
forward have been achieved |26j. 

In a nutshell, here, we summarize what the GG or AC identities state for the p = 2 case. 
Consider the overlaps among s replicas. Add one replica s + 1; then the overlap q a ,s+i between 
one of the first s replicas (say a) and the added replica s + 1 is either independent of all other 
overlaps, or it is identical to one of the overlaps q a b, with b ranging across the first s replicas 
except a. Each of these cases has equal probability s _1 . 

This property is very close to the relation obtained within the Parisi picture: Integrating over 
q23 in this equation, the joint probability distribution for the overlaps q±2 and (/13 corresponding 
to the case s = 2, a = 1 above becomes 



where P(.) is the probability distribution of the overlap between any two replicas. Dividing by 
P(qi2) gives the conditional probability P{qi?,\qi2), an d the formula above then says precisely 



d 



a(P,{.))=dfpa(p,(.)). 



(115) 




(116) 



P(qi2, 913) = P{qi2) 2^12 - qn) + -^P{qn) 



(117) 
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that the two overlaps are independent with probability one half and identical with the same 
probability. Even when we consider two overlaps between two distinct pairs of replicas the 
correlation remains strong; in fact, still following Parisi 

p(m, m) = 1^(912)^(934) + ^(912)5(912 - 934). (us) 

5.4 Zero average polynomials at even p 

Let us now see how to prove these properties in p-spin glasses (or at least the equality of the 
second moments of the relevant distributions) following Ghirlanda and Guerra argument |17| . 
Denote by e(a) = H^{a)/N the energy density; the dependence on N will be left implicit below. 
This quantity is self- averaging: 

lim {(e{of) - (e(a)) 2 ) = 0. (119) 

iV— >oo 

Let us sketch an euristic proof of (|119p : 

(e{a) 2 )-(e(a)} 2 = Eoj(e(a) 2 )-[Euj(e{a))} 2 = E[u{e{a) 2 )-u 2 {e{<j))] + [Eu 2 {e{o))-{Euj{e{<j))) 2 }. 

(120) 

The second term is the variance with the disorder of the Boltzmann average of the energy density 
and, as N — > 00, it goes to zero. The first term is equal to — N~ 1 dpEuj(e(a)) and, since Ew(e((j)) 
is finite, the prefactor iV -1 forces also this contribution to go to zero as N — > 00. A rigorous 
proof for the p = 2 case can be found in |13] and in |30j for a generic even p. 

The property f j 1 1 9 P is fundamental because it implies, for any function F s of overlaps among 
s replicas, 

lim ((e(a a )F s )-(e(a))(F s ))=0, (121) 

iV— >oo 

where by e(a a ) we mean e(a) calculated on replica a, taken to be one of the replicas that appear 
in F s . Equation f 1 1 2 1 [) can be obtained easily from the Schwartz inequality: 



hm ((e(a a )F s )-(e(a))(F s )) 2 = (122) 

N— >oo 

lim <(e(0 - (e(a)))F s ) 2 < (123) 

N— >oo 

lim ((e(a a )-(e(a))) 2 )(F 2 )=0 (124) 

iV-»oo 

The first term in (112 1 1) can be evaluated again using Gaussian integration by parts: 



il<...<i p l<b<s 



while the second term is simply 



(e(a))(F s ) = -^(l-( q p 12 ))(F s ). (126) 
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Combining equations f|125[) and (|126p we obtain the first type of GG relation 

lim (F s ( X ^ - < s+1 - (1 - <&»)) = 0. (127) 



7V->-00 

1<6<s 

Since .F s is a generic function, this result implies [17J that, conditionally on all the overlaps q c d 
with 1 < c < d < s, 

« s+ x) = l s (<fi2) + - s X <&• ( 128 ) 

l<b<s,b^a 

This is consistent with our description above of the physical content of the GG relations; the 
particular example s = 2, a = 1 corresponds to the second moment of (|117p . 

In the same way it is possible to derive a constraint for averages involving s + 2 replicas by 
using 

Efi(e(«7))fi(F s ) - EO(e(o-))Efi(F s ) = 0, (129) 

which is based on the vanishing of the second term of eq. (|120p . One obtains the second type of 
GG identity, 

(F s ( X < s+1 + (q P 12 ) - (a + l)q p s+w ) ) = 0. (130) 

1<6<s 

Again, invoking the arbitrariness of F s , this tells us that conditional on the overlaps among the 
first s replicas 



(<&fi, s +2> = X << s +i> + j-tt^) 



S + - 

1<6<s 

v ; l<a<fe<s 

where the second equation follows by inserting (|128p . The specific case s = 2 corresponds to the 
second moment of (|118p as expected. 

Finally, subtracting (|129p from (|12ip . which is equivalent to exploiting the vanishing of the 
first term in eq. (I120p . leads to the self- averaging relation 

E[n(e(a a )F s ) - n(e{a a ))n(F s )} = 0, (132) 

from which it is possible to obtain, again for some fixed 1 < a < s, 

(Fs( £ € b -<s + l- X < s+ i + (« + 1 )^ +W ))- (133) 

l<b<s,b^a l<b<s 

Summing over a and dividing by two, this last relation becomes 

K X €b~s X < s+ i + ^^^ +M+2 )>=0, (134) 

l<a<b<s l<a<s 
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which is the general form of the AC relations. It is interesting to note that the l.h.s. of eq. (|134l) 
equals 2N f3d/3{F s ) , as one verifies by direct calculation: As the /3-derivative must be 0(1) we 
can then directly argue that f|134j) vanishes for large N, and does so generically as 1/N. 

Moving on to concrete examples, the most famous GG relations are those obtained from 
F s = q^ 2 i where the exponent p makes us focus on the energy term of the p-spin model. They 
are typically written in the form 

<<&<&> = 5<«S> + \(<%2? (135) 
= ^<© + !<(&> a . (136) 
Eliminating (qf 2 } 2 > we S e ^i as expected, the AC relation for F s = q? 2 

~ 4(&<&) + 3(^f 4 ) = 0. (137) 



5.4.1 Overlap constraint generators 

We now show that within our smooth cavity field framework these relations can be obtained very 
simply from the stochastic stability of filled monomials (Theorem [5]). Specifically, we claim that 
the AC identities follow from the i-independence that obtains for averages of such monomials 
when N — > oo, and specifically from the vanishing of the i-derivative at t = (3 2 : if F s is a filled 
monomial, then 

lim d t (F s )\ t= p=0. (138) 

This property, for generic t, has already been used in our smooth cavity expression, where we 
did not evaluate the streaming of filled graphs like q^ 2 because they are independent of t. 
To see that we can also generate constraints for the overlaps, we combine i-independence with 
the fact that for t = f3 2 , by Theorem [HJ the perturbed Boltzmann state effectively reverts to the 
unperturbed state of an enlarged system. Explicitly, we have by evaluating the t-derivative in 
(|138p using the streaming equation (Theorem [8]) : 

Jim (F s ( £ C 1 ~ ' E <sli + £ ^Ct +2 ) )t=P = 0. (139) 

l<a<6<s l<a<s 

Now, given that F s is filled, all the terms here are fillable. Because we are evaluating at t = /3 2 , 
then from Theorem [6] their averages reduce to unperturbed averages of the corresponding filled 
expressions. Filling in this case just means squaring all the overlaps inside the brackets, and so 
we get directly 

iTJ Fs ( £ - s E C + l + £ ^^€ + l >s+2 )> = o. (140) 

l<a<6<s l<a<s 

This is nothing but the general AC relation (|134p . as claimed. 

From the streaming of the simplest filled monomial (i.e. {q^)) we find the first AC relation 
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lim d t (q p l2 ) t= p2 = lim (q& - 4g£,gg 3 + 3gf 2 gf 4 ) = 0, (141) 

N— >oo N— >oo 

which denotes overall a perfect agreement among results from our approach and previous knowl- 
edge on p-spin models. 

6 Conclusions 

In recent years spin-glasses have attracted a growing interest raised as, day after day, these 
systems are becoming the bricks for building models to describe behavior of complex systems, 
ranging from biology to economics. As a consequence, there is a need for stronger and stronger 
analytical methods possibly related with the numerical and experimental findings. This paper 
wes written with the intention of offering a detailed analysis of a well-known model, namely the 
p-spin-glass, through two recent methods: the Hamilton- Jacobi technique and the smooth cavity 
expression. We first provide a picture of the behavior of the p-spin-glass, from a perspective 
which is intermediate between that of the pure theoretical physicist and that of the rigorous 
mathematician, hoping to help in bridging the gap between these two approaches. Then, we 
explain the methods and use them with abundance of details, so to allow the reader to learn 
them. Indeed, our focus is more on techniques and on their versatility rather than on results 
themselves, which are mostly already known |15 [ [T8l [30] . 

Summarizing, after a streamlined introduction to the basic properties of the model (expression 
for the internal energy and convergence of the infinite volume limit), within the Hamilton- 
Jacobi technique, we obtained analytical expressions for both the RS and the 1-RSB free energies 
and we gain a clear mathematical control of the underlying physical assumptions. Within the 
smooth-cavity method, we showed how to build the expression of the free energy through overlap 
correlation functions and we analyzed the polynomial identities, that always develop in frustrated 
systems, derived as consequences of the stability of the measure limjv^oo ^ CT with respect to small 
(negligible) random stochastic perturbations. 

It is interesting to note that in the mean field techniques we developed, there is a certain 
degree of complementary between the two approaches as within the former we use a trial overlap 
coupled with a single particle free spin, while in the latter we use p — 1 spins for the cavity: both 
methods essentially work by reducing the problem to a single-body one, the Hamilton- Jacobi in 
a direct way, the smooth-cavity in a complementary way. 

Further investigations should be addressed to the study of the diluted frustrated p-spin model 
and its relation with K-satisfiability problems and P/NP completeness. 
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A Derivatives of the generalized partition function respect to the 
interpolating parameters 

We show here the derivation of expressions (|49[ [50]) . Let's start with the first one: 

d t a N = —F. Z- l dtZ (142) 

It's easy to see that 

Z- x d t Z a = K a+l f a+l Z-^d t Z a+1 (143) 

so that 

EoZ^dtZo = E E 1 ..M K f 1 ...f K Z K 1 d t Z K = Eh...f K Z^d t Z K (144) 
and, remembering that Zk = Z^, 



EoZ^dtZo = -W|^ Yl K(/ 1 .../ K J n ...^(a n ...a J J). (145) 

Integrating by parts the J^...^ inside the expectation becomes a derivative: 

K 



1 tp\ 



ill \" 

ON 



l<h<...<ip<N 



J2'K(f 1 ...dj ii m .. ip fa-fK&(<Ti 1 ...ai p ))+'E.(f 1 ...f K dj il ...^((Tn-cr^)) 

,a=2 

(146) 

We now proceed by computing separately the two addends in the square brackets, for the second 
term we easily find 



dj^icTi,..^)) = y ^- T (l-u, 2 (a il ...a ip )) (147) 

while for the first term we have 

QJ% x ...i v fa = m a f a Z~ 1 dJ il ...i p Z a - m a f a E a (f a Z~ 1 dJ il ...i v Z a ). (148) 
Now, using the analogous of (|143p . one has 

Z- x dJ ix .., v Z a = E a+1 ...E K (f a+1 ...f K Z K 1 dJ il ... ip Z K ) (149) 

/; '' ju) a (a h ...a ip ) (150) 



2NP 

and then for a > 2 (remind that f\ = 1 so its derivative is zero) 



dJ ix ... ip fa = \/ 2Np _ 1 m a fa(u a (<Ti 1 ...<Ti p ) ~ U a -1 (°h ■ ■ -°i v )) • (151) 
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Putting together the terms computed we find 

i ! r K 

EoZ^dtZo =4^TT ^2 ^2Eo...E a (f 1 ...f a u} a (ai 1 ...a ip )fa+i...fKU}((Ti 1 ...(Ti p ) 



K 



l<h<...<i v <N 



a=2 



^E ..M a (fi...f a u a (a il ..^i p )f a+1 ...fK&(cri 1 ...a ip ) 



(152) 



a=2 



+ l-E ...E K (f 1 ...f K u> 2 (a il ...a ip )) 



and noting that in the thermodynamic limit p\ X/i!< <j p ~ i p we have 



d t a N = - 



K 



a=l 



(153) 



from which the derivation of (|49p is straightforward. 

Let's now compute the derivatives of the free energy respect to the "spatial" parameters: 



da&N = j^o z o 1 d a Zo 



-E(f 1 ...f K Z^d a Z K ) 



(154) 



N 



' ' :^E(/ 1 .../ x ^J^(a i )) 



where we used the analogous of ([144|) . Integrating by parts this becomes 

i r K 

d a a N =^E ^ E x ..M K {Y,h-dj?fb-fKu{vi)) 



b=2 



(155) 



+ E 1 ..M K {f 1 ...f K djaCj(a i )) 



The derivatives of the state and of /& respect to the random fields are respectively given by 



p-2 



djaoj(ai) = ^fx^q a ^ (1 - w 2 (crj)) 

™>bfb(Zb 1 djaZ b - EbfbZ^djaZb) if a < b 

mbfbZ^djaZb if a = b 

if a > b. 



djffb = < 



(156) 
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Using again the iterative derivation formula we have 

Z b 1 dj*Z b = E b+1 (f b+ iZ b ^ 1 djaZ b+1 ) 

= E b+1 ...E K (f b+1 ...f K Zx 1 dj°-Z K ) 



p-2 



fx^q a 4 E b+1 ...E K (f b+1 ...f K u)(a i )) 



p-2 



fx^q a 4 u b {pi) 



so that 



p-2 



^Jx^q a 4 m b f b {uj b {(Ji) - w 6 _i((Tj)) if a < b 

p-2 

y/x^qa 4 - m b f b u) b (ai) if a = b 

if a > b. 



Substituting these in the (I155p . the first term inside the square brackets becomes 

K P-2 

Ei...E*r(^ h...d J «f h ...f K Cj{a i )) =V^fe V [m a E 1 ...E a (f 1 ...f a uj 2 a (a i )) 



6=2 



A' 



+ rn b K 1 ..M b (f 1 ...f b uj 2 b (a i )) 

b=a+l 
K 

- m 6 Ei...E^i(/i.../ 6 _ia;£((7 i ))] 



6=a+l 



and we find 



I p-2 

d a ON = ^^a 2 [m a (qaa')a + m b ({q aa i) b - (q a 

6>a 



'hn'fb-l) + 1 - (q<ra')K\ 
from which, after some manipulations, one can easily obtain the (|50p . 
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(159) 
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